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FOREWORD 


This  research  was  begun  under  the  former  Task  71636,  '  Effective  Use  of 
Knowledge  of  Performance  in  Training  Equipment, "  with  the  author  as  Ta.sk  Scientist. 
That  task  was  one  of  several  under  Project  7197,  "Human  Factors  in  Design  of 
Operator  Trainers,  "  with  Dr.  Ross  L.  Morgan  as  Project  Engineer.  Work  under  it  is 
being  continued  under  Task  71605,  "Human  Factors  in  the  Design  of  Devices  for 
Operator  Training  and  Evaluation,  "  of  Project  1710,  "Human  Factors  in  the  Design  of 
Training  Equipment,"  with  Dr.  Marty  R.  Rockway  as  technical  supervisor  of  both. 

Dr.  Theodore  E.  Cotterman,  the  author,  is  a  member  of  the  Training  Psychology 
Branch,  Behavorial  Sciences  Laboratory,  Aerospace  Medical  Division  of  the  Wright 
Air  Development  Division. 

The  data  were  gathered  and  analyzed  at  the  Ohio  State  University  as  a  portion  of 
the  services  provided  under  Contract  AF  33(616)-3076,  "Collection  and  Analysis  of 
Research  Data  on  Human  Factors  in  the  Design  of  Training  Equipment."  Dr.  Delos  D. 
Wickens,  who  was  Principal  Investigator,  and  Dr.  Henry  Cross  provided  general 
supervision;  Mr.  Jason  Black  and  Mr.  William  Pearson  ran  the  subjects;  and  the 
analysis  was  performed  by  the  various  members  of  the  project  staff. 


ABSTRACT 


Ninety  male  undergraduate  subjects  estimated  individually  with  respect  to  120 
stimulus  photos  how  many  degrees  a  1/4-inch  arrow  would  have  to  be  turned  to  exactly 
parallel  an  adjacent  arrowheaded  line  drawn  across  a  3-1/2-inch  circle.  The  stimuli 
were  presented  for  five  seconds  with  ten  seconds  between  and  longer  rest  intervals 
separating  sets  of  24.  Each  set  contained  examples  of  the  same  24  different  stimuli 
in  random  order— correct  answers  ranging  from  11  to  44  degrees  and  never  being 
duplicated.  Knowledge  of  results  given  orally  after  each  estimation  ranged  in  specificity 
from  simple  right -wrong  information  to  amount  and  direction  of  error  information  for 
five  experimental  groups.  No  knowledge  was  given  a  sixth  control  group. 

Differences  in  mean  absolute  and  algebraic  error  per  stimulus  among  groups 
reflect  differences  in  specificity  of  knowledge  given.  It  is  concluded  that  knowledge 
of  results  increases  the  rate  and  level  of  learning  to  perform  an  ^solute  judgment  o 
spatial  extent  and  this  effect  is  generally  greater  the  more  specific  the  knowledge. 


PUBLICATION  REVIEW 


WALTER  F.  GRETHER 

Technical  Director,  Behavioral  Sciences  Laboratory 
Aerospace  Medical  Division 
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EFFECTS  OF  VAJAiATIOWS  IN  SIECIFIGITY  OF  ivNO'.iLEDGE  OF  RESULTS 
ON  THE  IwlPiiOVEIiENT  OF  A  PERCEFT’UAL  SKILL 


INTRODUCTION 

A  commonly— accept 6d  technique  for  effective  training  is  to  provide  the 
trainee  with  knowledge  of  the  results  of  his  performance,  or  psychological 
feedback.  Learning  is  generally  expeftted  to  be  improved  when  the  trainee 
is  given  information  about  his  performance  beyond  what  is  naturally  avail¬ 
able  as  a  result  of  performing  the  task.  This  general  principle  is  support¬ 
ed  by  numerous  research  studies  on  the  learning  of  various  kinds  of  tasks. 
However,  through  precedent  and  the  vagaries  of  researcher's  personal  inter¬ 
ests,  some  kinds  of  behavior  have  been  more  extensively  studied  than  others. 

Perceptual  skills  are  among  those  kinds  of  behaviors  for  which  the 
effects  of  knowledge  of  resxHts  are  less  well  determined.  True,  enough 
has  been  done  to  warrant  the  conclusion  by  Gibson  (1953)  that  if  knowledge 
of  res\alts  is  not  absolutely  necessary  to  the  improvement  of  a  perceptual 
judgment,  it  is  at  least  of  great  value.  Evidence  for  this  is  found  in 
research  on  the  tasks  of  judging  whether  one  or  two  points  are  contacting 
the  skin  (Solomons,  1897);  grading  handwriting  (Gilliland,  1925);  estima¬ 
ting  length  (Thorndike,  1927);  estimating  auditory  number  (Taubman,  19uU); 
estimating  visual  number  (Linturn  and  Reese,  1951);  and  judging  visual 
stimuli  differing  in  size,  brightness  and  hue  (Eriksen,  1957)*  ■  However, 
these  studies  do  not  go  beyond  the  validation  of  the  general  principle  to 
explore  the  effects  of  systematic  variations  in  the  knowledge.  Thus,  one 
may  ask  how  changes  in  the  specificity  of  the  information,  or  in  the  pre¬ 
cision  or  accuracy  of  the  infomation,  or  in  the  frequency  of  giving  infor¬ 
mation,  or  in  the  time  at  which  it  is  given  influence  the  effectiveness  of 
the  learning  experience. 

Specificity,  as  one  kind  of  variation  in  knowledge  of  results,  may  be 
defined  as  the  degree  to  which  information  given  the  learner  describes  the 
manner  in  which  his  performance  deviates  criterion  performance.  The 

effects  of  variations  in  the  specificity  of  knowledge  about  a  perceptual 
response  have  been  investigated  by  Hamilton  (1929)  and  by  v/aters  (1933) • 

Hamilton  studied  the  effect  of  five  different  incentive  conditions  on 
judgments  of  length.  Sixty  undergraduate  women  individually  made  50  attempts 
on  each  of  two  days  to  set  a  flexible  rod,  controlling  the  length  of  a  hori¬ 
zontal  bar  of  light,  in  such  a  way  as  to  make  the  variable  bar  twice  as  long 
as  a  standard  (120  mm.)  one.  Beginning  with  the  sixth  attempt  on  the  second 
day  an  equal  number  (10)  of  subjects  (^s)  were  given  the  following  treat 
ments;  (1)  punisliment  -  a  bell  sounded  after  each  wrong  response;  (2)  re¬ 
ward  -  a  bell  sounded  after  each  correct  response;  (3)  guess-T^vith-punish- 
ment  -  a  bell  sounded  after  each  v/rong  response  and  Ss  then  guessed  whether 
their  adjustment  was  long  or  short;  (U)  told-with-puiiishment  -  a  bell  sound¬ 
ed  aiter  each  wrong  response  and  the  experimenter  (E)  said  "long"  or  "short;" 
(5)  knowledge  -  E  said  "long,"  "short,"  or  "correct”  after  each  response; 
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and  (6)  a  control —no  bell  or  knowledge*  Analysis  of  error,  expressed  as 
a  percentage  of  average  error,  showed  all  incentive  conditions  superior  to 
the  control  condition.  Told-  and  guess-with-punishment  groups  did  not  ^f- 
fer  significantly,  but  vfere  superior  to  reward  and  punishment  groups  which 
also  did  not  differ  significantly.  The  knowledge  group  was  inferior  to  all 
other  incentive  groups  (significantly  so  for  guess-  and  told-with-punistoent 
groups).  In  general,  the  time  required  for  settings  was  uncorrelated  with 
error  and  decreased  with  practice.  At  least  superficially,  the  resets  of 
the  experiment  are  at  variance  with  the  common  sense  hypothesis  that  per¬ 
formance  is  directly  related  to  the  specificity  of  knowledge  of  results. 

But,  there  are  several  possible  explanations  for  the  knowledge  group  s  in¬ 
ferior  performance.  First,  variations  in  specificity  vrere  confounded  vath 
variations  in  the  time  relations  because  the  bell  was  sounded  i^ediately 
after  the  response  and  E's  remarks  followed  after  some  delay.  Second,  it 
is  possible  that  once  the  Ss  were  sure  they  had  made  an  error,  they  already 
had  sufficient  inf orraation“to  guide  future  responses.  Finally,  the  bell 
may  have  been  intrinsically  more  reinforcing  and  motivating  and  so  enhanced 
performance  relatively  more  than  simple  knowledge  (cf.  Brown,  19U9;* 

Waters  reported  two  studies  on  the  learning  of  a  perceptual  judgment. 
According  to  an  abstract,  in  the  first  study,  improvement  in  judpng  the 
length  of  cardboard  strips  seemingly  was  luirelated  to  degree  of  infomation 
given.  In  the  second,  estimations  of  a  12-second  interval  Mprwed  in  pro¬ 
portion  to  degree  of  information.  Thus,  the  effect  of  specificity  may  de¬ 
pend  on  the  nattire  of  the  task  being  learned. 

Experimental  variations  in  specificity  also  have  Produced  contradicto^ 
results  in  the  learning  of  nonperceptual  tasks.  Ross  (1927)  had  Ss  in  small 
groups  individually  practice  making  as  many  tallies  (four  vertical 
with  one  diagonal)  as  they  could  in  a  one-minute  trial.  Those  who  had  the 
opportunity  to  see  the  previous  day's  paper  marked  with  errors  and  scores 
and  a  frequency  table  for  the  group  and  who  were  urged  to  watch  progress 
and  prepare  learning  cvirves  performed  better  than  those  v^o  were  simply 
told  who  was  above  and  who  was  below  average.  Those  receiving  no  informa¬ 
tion  were  worst  by  a  slight  margin.  No  change  in  effects  was  noted  on  the 
last  two  trials  when  those  receiving  the  most  knowledge  were  pven  none 
and  the  others  were  given  full  knowledge.  However,  this  finding  was  not 
confirmed  in  several  experiments  Ross  (1933)  performed  in  classroom  situa¬ 
tions.  Different  degrees  of  knowledge  of  weekly  test  performance  did  not 
produce  differential  learning. 

In  a  classic  experiment,  Trov^bridge  and  Cason  (1932)  studied  improve¬ 
ment  in  drawing  three-inch  horizontal  lines  while  blindfolded.  Four  groups 
of  1^  male  and  female  students  were  differentially  treated  in  100  practice 
trials  according  to  whether  E  responded  after  each  trial  by  saying  nothings 
or  saying  a  nonsense  syllable;  or  saying  "right"  if  ^^thin  V8  inch,'  other¬ 
wise  "wrong;"  or  saying  "plus  X,"  "minus  X,"  (indicating  1/8  inch  error 
units)  or  "correct."  As  indicated  by  mean  percent  correct  and  average  er¬ 
ror,  those  receiving  information  on  amount  and  direction  of  error  wrere  far 
superior  to  the  others.  Those  receiving  right-wrong  information  were  bet¬ 
ter  than  those  receiving  no  information,  and  those  given  nonsense  syllables 
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were  worst  of  all.  In  a  second  series  of  100  trials  Ss  in  each  group  were 
divided  equally  among  the  three  conditions  not  encountered  in  the  first 
series.  The  same  relative  performances  were  noted  for  the  various  condi¬ 
tions  • 


Rock  (1936)  found  that  knowledge  of  the  number  of  correct  responses 
made  in  a  IDO-item  series  had  but  slight  effect  on  the  learning  by  children 
of  which  of  the  ntimbers  1  through  5  were  associated  with  which  of  eight 
stimulus  words  presented  successively  in  random  order.  Adding  knowledge 
of  nxmiber  correct  to  knowledge  of  "right  or  wrong"  after  each  response  re¬ 
sulted  in  slight  advantage.  Hirsch  (1932)  compared  the  effects  on  retest 
performance  of  several  knowledge— of— results  conditions  used  in  conjunction 
with  test  films.  Presentation  of  a  neon  light  after  each  correct  response 
along  with  the  question  and  the  correct  answer  proved  superior  to  either 
the  neon  light  alone  or  the  neon  light  along  with  the  number  of  the  correct 
answer.  Simply  reshowing  the  original  training  film  was  as  helpful  as  the 
neon  light  vrith  the  question  and  correct  answer^  but  the  best  condition  was 
a  combination  of  both.  (To  the  extent  that  recall  of  test  questions  and 
responses  is  stimulated  by  it,  the  film  affords  considerable  knowledge  of 
results. ) 

Parks  (193U)  found  that  upon  test  Ss  performed  the  best  tracking  and 
ranging  on  a  flexible  gunnery  device  if  they  were  given  their  time  scores 
for  each  of  the  six  directions  after  each  training  trial.  This  condition 
was  contrasted  with  time  scores  for  the  three  dimensions  after  each  trial, 
group  means  after  training  sessions,  and  personal  conversation  after  each 
trial.  The  effect  upon  the  same  kind  of  skill  of  three  other  conditions 
was  explored  by  Goldstein  and  Rittenhouse  (193U).  They  compared  the  value 
of  a  buzzer  signal  when  on— target  simultaneously  in  all  dimensions  vrith 
a  verbal  statement  after  each  trial  (including  proportion  of  time  on-target 
and  comparisons  of  performance  on  different  trial  segments  and  with  the 
previous  record)  and  with  a  tuition  condition  (consisting  of  the  verbal 
statement  plus  statements  about  S's  specific  error  tendencies).  In  gen¬ 
eral,  the  amount  and  kind  of  knovrledge  of  results  made  little  difference, 
although  according  to  performance  the  buzzer  was  best,  tuition  next,  and 
verbal  statements  last.  However,  after  use  of  the  buzzer  was  discontinued 
performance  deteriorated  to  control  levels  and  upon  transfer  to  a  slightly 
different  tat  ;  actually  became  v/orse  than  control  performance. 


In  general,  many  of  these  studies  do  not  offer  critical  evidence  on 
how  the  specificity  of  knowledge  of  results  is  related  to  its  effective¬ 
ness  for  learning.  It  is  aoparent  that  precise  control  of  specificity 
was  often  lack;Lng.  For  exanple,  in  Ross's  classroom  experiments  Ss  still 
had  some  knowledge  of  results  through  classroom  discussion  of  frequently 
missed  problems.  Other  experiments  confound  guidance  conditions  (Ross, 
1927),  or  time  of  giving  the  knowledge  (Hamilton,  Hirsch,  Goldstein  and 
Rittenhouse)  or  different  levels  of  specificity  (Hirsch  and  Rock)  ivith 
specificity  per  se  in  a  vray  as  to  make  inferences  from  them  hazardous. 
Hovvever,  the  experiments  by  Trowbridge  and  Cason  and  by  Parks  clearly  sug¬ 
gest  that  performance  is  directly  related  to  the  degree  of  specificity  of 
"the  information  given  the  trainee  about  his  periorma.nce. 
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Purpose  and  Hypotheses.  Perceptual  judgments  are  pervasive  in  the 
work-a^day  vrorld.  In  some  cases  they  constitute  the  primary  portion  of  a 
task:  in  others  they  are  necessary  portions  of  complex  tasks  on  iwhich 
other  portions  depend.  In  any  case,  -whenever  training  or  a  training  de-vice 
must  be  designed  to  aid  the  learning  of  a  task  involving  perceptual  judg¬ 
ments,  it  is  important  to  consider  -whether  kno'wledge  of  results  must  be 
provided  and,  if  so,  -vjith  -what  degree  of  specificity.  More  exact  knowledge 
of  the  effects  of  variations  in  specificity  v/ould  be  helpful  in  making  such 
design  decisions  -  especially  v/hen  the  provision  for  highly  specific  know¬ 
ledge  or  scores  -svould  entail  considerable  time  and/or  expense. 

The  experiment  being  reported  was  to  serve  the  purpose  of  exploring 
the  effects  of  variations  in  the  specificity  of  knowledge  of  results  on 
rate  and  level  of  learning  of  a  simple  perceptual  judgment.  The  judgment 
selected  for  use  ’was  the  absolute  one  of  estimating  the  extent  of  angular 
separation  to  the  nearest  degree.  Some  normative  data  are  available  for 
judgments  of  this  sort  as  a  function  of  the  physical  characteristics  of 
the  stimulus  (Reese,  19^3;  Baker  and  Grether,  195U)»  However,  to  the 
■vyriter’s  knowledge,  no  information  is  available  on  the  partic-ular  stimu¬ 
lus  arrangement  used  or  on  the  learning  of  this  skill.  The  stimulus  ar¬ 
rangement  was  selected  because  of  the  likelihood  of  encountering  displays 
having  similar  characteristics  in  weapon  systems. 

Stated  formally,  the  hypotheses  under  test  are  as  follows:  (l)  Rate 
and  level  of  learning  to  estimate  ang\ilar  separation  are  increased  -when 
knov/ledge  of  res^llts  is  given,  (2)  Rate  and  level  of  learning  to  estimate 
angular  separation  are  directly  related  to  the  specificity  of  the  knowledge 
of  results  given. 


METHOD 

Subjects.  ITie  subjects  (S^s)  for  the  experiment  vfere  90  male  college 
students  ^vided  equally  and  at  random  into  six  groups.  Eight  of  these  S^s 
were  replacements  for  others  -which  were  rejected.  Of  those  rejected,  five 
were  misrun  as  a  result  of  experimenter’s  error,  one  had  participated  in  a 
pilot  study,  one  lacked  sufficient  time  to  complete  the  experiment,  and  one 
failed  to  follow  instructions. 

Stimuli.  The  stimuli  consisted  of  ^  x  6-inch,  -white,  matte  photos. 
Centered  on  each  of  them  was  a  34-inch  circle  in  bold  outline  with  an  arrow- 
headed  line  running  completely  across  it  and  a  smaill  (4-inch)  arrow  adjacent, 
but  not  parallel,  to  the  line.  Fotir  fine  lines  radiating  l/l6  inch  outward 
from  the  periphery  indicated  main  directions.  The  stimuli  differed  as  to 
direction  arid  position  of  the  arrow  and  the  line  so  that  there  were  2U  dif¬ 
ferent  arrangements.  In  an  equal  number,  or  three,  of  these  the  arrowhead¬ 
ed  line  pointed  at  each  one  of  the  eight  main  compass  points  -  passing  in 
one  through  the  circle’s  center  and  in  the  other  two  a  perpendicular  dis¬ 
tance  of  3/U  inch  on  either  side  of  center.  The  small  arrow  was  randomly 
positioned  anywhere  along  the  line  (except  near  the  circle  perimeter)  and 
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from  3  to  12  mm.  away  from  the  line  at  its  nearest  point.  Allliough  it  was 
oriented  in  the  same  general  direction  as  the  line,  the  arrow  deviated  by 
11  to  lUi  degrees  from  being  parallel  to  the  line  and  the  amount  of  deviation 
was  never  duplicated. 

Five  copies  of  each  of  the  2h  different  arrangements,  or  120  stimuli  in 
all,  were  used  in  the  experimental  series.  These  were  grouped  into  five  sets 
of  2U  each  so  that  each  set  contained  copies  of  all  the  arrangements  but  in 
a  different  random  order.  For  convenience  in  handling,  the  stimulus-irfiotos 
7fere  cemented  to  thin,  i/diite,  6  x  6-inch  metal  squares  so  that  the  side  and 
bottom  edges  coincided. 

In  addition,  a  sample  stimulus  was  prepsu'ed  for  use  in  instructing  Ss 
(see  Figure  l).  It  differed  from  the  experimental  stimuli  in  that  the  arrow- 
headed  line  does  not  point  towards  a  major  compass  point  and  the  small  arrow 
deviates  by  a  combination  of  direction  and  angular  amount  not  used  in  the 
experimental  series.  Illustrations  of  the  experimental  stimuli  may  be  seen 
in  Appendix  A. 

Ap£aratus.  The  presentation  apparatus  consisted  of  a  vertical  boao?d 
(3  X  feet)  motmted  on  wooden  feet  and  placed  on  a  table  in  front  of  the 
seated  S.  A  3  x  7-inch  apertture  was  cut  in  the  board  so  as  to  be  directly 
in  S‘s  line  of  sight.  Behind  the  apertvire  was  a  stimulus  holder  tilted 
sli^itly  so  that  a  IjO-Vlfatt  lumiline  bulb  mounted  just  above  provided  faii^ 
ly  even  illumination  of  the  stimulus.  The  boaurd  obstructed  the  S*s  view 
of  the  exposed  upper  portion  of  the  metal  sqvuires  in  such  a  way  that  only 
the  5  X  6-inch  stimulus-piiotos  mo\mted  on  than  were  normally  visible.  A 
horizontally  sliding  panel,  somewhat  larger  than  the  aperture,  permitted 
the  experimenter  (E)  to  control  the  duration  of  S's  view  of  the  stimuli. 

The  TAiole  apparatus  was  painted  dull  black.  A  d^sk  lamp  used  by  E  behind 
the  apparatus  constituted  the  main  source  of  light  in  the  small  sound-pro¬ 
tected  cubicle  in  which  the  experiment  was  done.  This  lamp  was  arranged 
so  that  to  S  the  top  and  side  edges  of  the  board  appeared  evenly-surrounded 
by  light  of’moderate  intensity,  thus  alleviating  the  impleasantness  of  the 
contrast  between  the  brightly-lighted  white  stimuli  and  the  black  board. 

Procedui‘e .  Upon  reporting  for  the  experiment  each  S  was  seated  before 
the  apparatus  and  read  the  same  general  instmictions.  The  instmctions  in¬ 
formed  the  S  that  each  of  a  series  of  stimulus  cards,  like  the  sample,  would 
be  displayed!  through  the  aperture  for  about  five  seconds  and  requested  that 
he  respond  to  each  card  as  follows : 

"For  each  card  imagine  that  you  are  flying  a  plane  in  the  direction 
shown  by  this  small  arrow.  The  long  line  with  the  arrcw  on  one  end  shows 
the  direction  in  which  you  are  supposed  to  fly.  I’d  like  you  to  tell  me 
how  many  degrees  you  would  have  to  turn  to  fly  in  the  same  direction  as 
the  long  line,  that  is,  so  that  the  small  arrow  would  be  paraillel  to  the 
line." 
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Figure  1.  The  Sample  Stimulus  (20°) 
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After  giving  the  general  instructions  the  E  contimied  -vvith  an  addition¬ 
al  statement  according  to  the  S's  assignment  to  one  of  the  six  treatment 
groups.  These  statements  described  the  kind  of  information  the  S  would  be 
given  about  each  estimate.  Accordingly,  information  given  to  five  of  the 
groups  ranged  in  specificity  from  a  statement  as  to  whether  the  estimate 
made  was  right  or  wrong,  to  a  statement  of  the  correct  ansirvar.  No  informa¬ 
tion  was  given  to  a  sixth,  control  group.  Table  1  contains  a  suraraaiy  of 
these  different  treatments.  A  complete  copy  of  the  instructions  read  to 
Ss  may  be  found  in  Appendix  B. 


TABLE  1 

Rules  for  diving  Knowledge  of  Results  to  the  Vsirious  Groups 


Group  Knowledge  of  Results 

I  no  information 

II  "ri^t"  if  either  correct  to  nearest  degree  or  no 

more  than  one  degree  in  error;  otherwise,  "wrong" 

III  "right"  if  correct  to  nearest  degree;  otheiwise, 

"wrong" 

IV  "over,"  "under,"  or  (if  to  nearest  degree)  "correct" 

V  "over  X  degrees,"  "under  x  degrees,"  or  (if  to 

nearest  degree )  "correct" 

VI  "x  degrees"  (the  correct  answer  to  nearest  degree) 


All  Ss  were  shown  successively  each  stimulus  of  each  of  the  five  2U- 
stimulus  sets.  Using  a  stopwatch,  E  presented  a  stimulus  for  approximately 
five  seconds,  allowed  10  seconds  to  elapse  during  which  he  noted  S*s  re¬ 
sponse  and  gave  the  appropriate  knovfledge  of  results,  and  then  presented 
the  next  stimulus.  S  was  permitted  a  2-rainute  rest  between  each  set,  with 
the  exception  that  he  was  given  a  6-minute  rest  between  the  third  and  fo\irth 
sets.  Thus  an  experimentail  session  required  U2  minutes  in  addition  to  the 
time  required  for  giving  instructions. 

The  stimulus  order  within  each  of  the  five  sets  was  always  the  same, 
enabling  the  convenient  recording  of  responses  on  a  prepared  record  sheet. 
However,  the  order  of  presenting  the  five  sets  to  Ss  within  each  group  was 
in  accordance  with  1^  quasi-random  orders.  The  orders  were  restricted  so 
that  each  set  was  first  three  times  and  last  three  times  and  all  20  possi¬ 
ble  digrams  were  represented  at  least  once  but  no  more  than  five  times. 

Thus,  within  a  group  the  sets  were  presented  in  a  different  order  to  each 
S,  but  the  same  orders  were  used  for  all  groups. 
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Scoring  and  Analysis.  For  each  presentation  or  stimulus,  subtraction 
of  the  correct  ansvrerf ran  the  corresponding  judgment  produced  a  score 
indicating  both  direction  and  the  amount  of  error.  In  subsequent  analysis 
these  were  treated  in  two  ways  -  as  absolute  error  (with  sign  disregarded) 
and  as  algebraic  error.  The  5^  level  was  used  in  all  tests  of  the  signi¬ 
ficance  of  differences. 


RESULTS 

Effects  of  Knowledge.  Mean  absolute  error  per  stimxilus  for  the  vari¬ 
ous  groups  is  plotted  against  sets  of  stimuli  in  Figure  2.  The  values 
plotted  may  be  found  in  Appendix  C  along  with  mean  absolute  error  per  stim¬ 
ulus  computed  over  blocks  of  six  stimuli.  The  within-group  fluctuations 
in  means  over  six  stimuli  indicate  that  performance  on  this  task  was  quite 
variable.  Mean  absolute  error  on  the  very  first  stimulus  for  Groups  I 
through  VI  was  ccmputed  to  be  8.7,  7.5,  8.8,  8.5,  7.7,  and  9.8  degrees 
respectively.  Since  these  means  do  not  differ  significantly  (F-ratio  of 
0.20)  the  groups  are  regarded  equal  in  absolute  error  before  differential 
treatment. 

From  Figure  2  it  is  evident  that  all  except  the  no-knowledge  group 
decreased  in  absolute  error  with  practice.  For  all  groups  except  Group  I 
the  reduction  in  mean  error  between  the  first  and  the  last  stimulus  sets 
is  significant  according  to  t-tests  summarized  in  Table  2.  Inspection 
serves  to  indicate,  however,  that  the  groups  did  not  all  improve  at  the 
same  rate.  Some  improved  very  gradually  while  others  had  virtually  reached 
their  terminal  level  in  the  third  set.  The  best  groups  showed  surprising¬ 
ly  little  error  after  training  -  only  about  four  degrees. 


TABLE  2 

Significance  of  Differences  in  Mean  Error 
Between  First  and  Last  Sets  of  Stimuli  (t) 


Absolute 

Algebraic 

Group 

Error 

Error 

I 

1.22 

1.U8 

II 

2,79^ 

0.87 

III 

0.5U 

IV 

3.73-»* 

0.85 

V 

2.80* 

1.50 

VI 

0.09 

*  p  <  .05 

p  <  .01  (ih  ^) 
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Figure  2.  Itean  Absolute  Error  Per  Stimulus  Plotted  Against  Sets  of 
Stimuli  • 


It  zilso  is  apparent  from  Figure  2  that  the  groups  differed  from  each 
other  at  each  successive  stage  of  practice.  The  no-knowledge  group  was 
generally  the  worst.  The  results  of  single  classification  analyses  of 
variance  summarized  in  Table  3  attest  to  the  over-all  significance  of  these 
differences  for  each  set  of  stimuli.  All  the  knowledge  groups  became  sig¬ 
nificantly  superior  to  the  no-knowledge  group  by  the  end  of  practice,  as 
shown  by  t-tests  surairaarized  in  Table  U. 


TABLE  3 


Significance  of  Differences  among  All  Groups  in 
Mean  Error  per  Stim\ilus  for  Sets  of  Stimuli  (F) 


Error 

Measure 

I 

II 

Stimulus  Set 

III 

IV 

V 

Absolute 

2,99* 

U.ooiHt 

U.87’^ 

5.62-»* 

5.7Ch:-«- 

(U63U) 

(3216) 

h(l4l0ii) 

h(3686) 

h(3573) 

Algebraic 

0.89 

0.88 

1.72 

2.83* 

3.00«- 

h(127Uli) 

(10151) 

(130U5) 

(10523) 

(10275) 

*  p  <  .05  p  <  .01  (5  and  8li  df ) 

h  -  variance  heterogeneous  according  to  Cochran's  test 


TABLE  li 

Significance  of  Differences  in  Mean  Error  Per  Stimulus  between  the 
No-knowledge  and  Each  of  the  Knowledge  Groups  for  Sets  of  Stimuli  (t) 

Stimulus  Set 


Knowledge 

Absolute  Error 

Algebraic 

!  Error 

Group 

Compared 

I 

n 

III 

V 

IV 

V 

II 

1.19 

0.6U 

l.lll 

0.88 

2.07* 

0.88 

0.58 

(28) 

(28) 

(28) 

(28) 

(28) 

(25) 

(22) 

III 

1.62 

0.67 

1.60 

2.11* 

2.35* 

2.23* 

1.69 

(28) 

(28) 

(28) 

(28) 

(23) 

(2U) 

(2U) 

IV 

2.86**- 

0.98 

2.85^«^ 

3.02-*M- 

2.8U** 

2.07 

6.57** 

(26) 

(28) 

(2U) 

(21) 

(21) 

(17) 

(18) 

V 

U.oi-^" 

h,28** 

3.77*'> 

U.06**!- 

2.16* 

2.33* 

(28) 

(21) 

(17) 

(16) 

(15) 

(17) 

(13) 

VI 

3,97-}H^ 

2.38* 

3.92-«^^ 

3.2^"^ 

3.5U*''^ 

1.99 

1.99 

(28) 

(28) 

(21) 

(23) 

(18) 

(15) 

(16) 

*  p  <  .0^  p  <  ,01  given  in  panrentheses) 
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Figure  3  displays  mean  algebraic  error  per  stimulus  plotted  against 
sets  of  stimuli.  (See  Appendix  D  for  tabled  values.)  Mean  algebraic  error 
on  the  first  stimiilus  was  found  to  be  -0»1 ,  0.6,  -1.7^  -l.U^-O.S,  and  -1.0 
for  Groups  I  through  VI,  respectively.  These  means  do  not  differ  signi¬ 
ficantly  (F-ratio  of  0.08)  and  so  the  groups  are  regarded  as  initially 
equal  in  algebraic  error.  In  contrast  v/ith  absolute  error,  most  of  the 
groups  made  slight  constant  error  initially  and  maintained  their  level  sub¬ 
sequently.  Groups  I  and  II  are  apparent  exceptions  in  that  they  tended  to 
progressive  overestimation  v/ith  practice.  However,  the  differences  between 
first-set  and  last-set  performance  are  in  no  case  reliable  (cf.  Table  2). 
Variability  aroimd  mean  algebraic  error  was  great,  as  is  indicated  by  the 
standard  deviations  given  in  Table  5*  Wiile  mean  standard  deviation  per 
stimulus  tended  to  decline  with  practice,  only  in  the  case  of  Group  VI  is 
the  difference  between  variance  on  the  first  and  last  set  of  stimuli  reli¬ 
able.  (For  Groups  I  through  VI,  respectively,  F-ratios  are  1.29^  2.12, 
2.29,  1.2U,  2.10,  and  U.U2.) 


Figure  3.  Mean  Algebraic  Error  Per  Stimulus  Plotted  Against  Sets  of 
Stiravili . 
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TABLE  5 


Mean  Standard  Deviation  Per  Stimulus 
for  Selected  Blocks  of  Stimuli  (s) 


Set  and 

Stimuli 

V,  19-2 U 

Group 

I,  1-6 

III,  19-2U 

IV,  1-6 

I 

11.81 

10.67 

9.8U 

9.93 

II 

11.30 

9.20 

9.33 

7.30 

III 

9.72 

7.98 

7.93 

6.32 

IV 

10  .U6 

7.76 

3.97 

8.17 

V 

8.63 

3.79 

3.06 

3*53 

VI 

8. hi 

6.32 

6.)43 

6.29 

The  groups  do  appear  to  differ  in  their  algebraic  error  even  though 
they  are  St  so  well-ordered  by  this  measure.  Over-all  tests  of  toe  dif- 
feSnSs  among  all  groups,  shovf  them  nonsignificant  for  the  first  three 
stimulus  sets?  However,  the  F-ratios  for  the  last  two  sets  are  si^ficant, 
as  is  shown  in  Table  3.  Fewer  than  half  the  differences  between  the  no- 
tooiledge  group's  perfonnance  and  each  of  the  knowledge  group's  performance 
™  SrSst  taS  sels  a«  significant  (cf.  Tabic  h).  no-kn»l^gc  group 

OTerestimatod  significantly  more  than  Groups  III  and  V  in  the  fourth  set 
and.  Groups  IV  and  V  in  the  last  set. 

Effects  of  Specificity.  Figure  2  makes  it  apparent  that  leaning, 
as  measured  by  absolute  error,  was  generally  greater  the  more  specific 
the  knowledge  of  results  given.  With  but  two  exceptions  (Groups  I  and 
II  orthe  Scond  set  and  Groups  V  and  VI  throughout)  the  groups  are  per- 
Sctly  ordered  according  to  specificity.  Actually,  since  Groups  II  and 
I?I  received  the  same  kind  of  information,  the  difference  in  their  treat¬ 
ment  is  not  properly  described  as  a  difference  in  specificity.  Instead, 
Seee  gr»pe  SS  in  the  precision  or  accuracy  of  the  specific  infer- 
mation  given  them.  In  consideration  of  this  and  the  lack  of  significant 
difference  between  them  (cf.  Appendix  E  for  t-values), 

wene  eonbined  for  the  purpose  of  testing  the  over-all  effect  on  absolute 
eSr  S  variations  in  specificity.  As  summartted  in  Table  6,  the  an^es 
^f  variance  comparing  the  knov, ledge  groups  only  she  the  eer-^1  effects 
of  specificity  significant  for  each  stimulus  set  except  the  first. 

The  significance  of  differences  in  mean  absolute  error  between  pairs 
of  knowledge  groups  was  determined  by  applying  the  t-test,  with  degrees  of 
freedom  adjusted  for  variance  differences.  In  general,  adjacent  treati^nt 
groups  did  not  differ  significantly,  although  more  extreme  ones  did.  Thus 

SHtLS^^S)  irS  after  the  first  set.  Group  V  and  Group 

VI  never  differed  significantly,  nor  was  either  one  of  these  groups  ever 
S^Scant^  superior to  Group  IV.  Group  IV  was  reliably  superior  to  the 
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combined  Groups  II  and  III  on  the  fourth  set  only.  The  order  of  signifi¬ 
cance  and  the  values  of  t  closely  parallel  the  ordeiang  of  groups  accord¬ 
ing  to  specificity,  -with  Groups  V  and  VI  juxtaposed.  Appendix  E  contains 
a  summary  of  these  analyses. 


TABLE  6 


Significance  of  Differences  among  Knowledge  Groups 
(II  and  III  combined)  in  Mean  Absolute  Error 


Per 

Stimulus 

for  Sets  of  Stimuli 

Stimulus  Set 

(F) 

I 

II 

III 

IV 

V 

F-ratio 

1.87 

5.17^«^ 

U.oU* 

li.i5«* 

3.U9'^ 

Within  Groups 

Var.  Estimate 

U758 

3152 

(h)35l5 

2827 

2270 

h 


p"  <  .05  ^p  <  .01  (3  and  71 

-  variance  heterogeneous  according  to  Cochran's  test 


The  performance  of  the  various  knowledge  groups,  as  measured  by  alge¬ 
braic  error  and  illustrated  by  Figure  3>  was  not  nearly  so  well-ordered 
according  to  specificity.  Only  Group  II  appears  to  have  made  much  constant 
error,  having  displayed  a  pronounced  tendency  to  overestimate.  However, 
Group  II  was  not  significantly  inferior  to  Group  III  on  either  the  fourth 
or  the  fifth  set  (t  values  of  1.81  and  1.69  respectively,  with  28  degrees 
of  freedom).  Since  Group  III  and  the  other  knordedge  groups  displayed 
quite  similar  performance  and  Group  II  only  was  deviant,  it  did  not  seem 
justifiable  to  combine  Groups  II  and  III  for  the  pvarpose  of  an  over-all 
test.  Instead,  Groups  II  and  III  were  separately  contrasted  with  Groups 
IV,  V,  and  VI  in  analyses  of  variance  of  performance  on  the  fourth  and 
fifth  sets.  Nonsignificant  F-ratios  of  0.37  and  0.09,  respectively,  were 
obtained  using  Group  III  (within  groups  estimates  of  iiiiU8  and  U9I8,  3  and 
56  df ) .  The  parallel  analysis  using  Group  II  resulted  in  a  nonsignificant 
F  of2.12  for  the  fourth  set  eind  a  significant  F  of  U.90  for  the  fifth  set 
(within  groups  estimates  of  h823  and  ilLU5).  The  variances  of  the  groups 
compared  are  heterogeneous  according  to  Cochran's  test  in  all  four  cases. 
Follow  up  t-tests  showed  Group  II  significantly  inferior  to  Groups  IV,  V, 
and  VI  on  ^The  fifth  set  (t  equal  2,hh,  2.92,  and  2.51,  with  28,  I9,  and 
20  ^  for  the  respective  ccmiparisons) . 
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DISCUSSION  AND  CONCLUSIONS 


Effficts  of  Knowledge.  The  first  hypothesis  under  test  seems  clearly 
confirmed  by  the  resiilts  obtained.  Rate  and  level  of  learning  to  estimate 
angular  separation  are  increased  when  knowledge  of  results  is  given.  Taken 
as  a  group,  those  receiving  no  knowledge  cannot  be  said  to  have  learned 
anything  because  they  showed  no  demonstrable  change  in  either  absolute  or 
algebraic  error.  However,  consideration  of  their  initial  performance  on 
the  very  first  stimulus  and  their  variability  throughout  suggests  the  pos- 
sibility  that  more  powerful  measures  woxild  have  shown  them  to  have  progressed 
to  an  increasingly  consistent  level  of  overestimation.  In  contrast,  those 
receiving  knowledge  of  results  in  all  cases  shovred  significant  improvement 
in  absolute  error  and  generally  reliable  superiority  to  those  receiving  no 
knowledge,  particularly  in  the  last  stages  of  practice. 

A  cursory  analysis  of  the  various  groups '  performance  vrith  respect  to 
difficult  and  easy  stimuli  points  up  the  effect  of  knowledge  very  nicely. 

The  six  hardest  and  the  six  easiest  items  on  first  presentation  to  the  no¬ 
knowledge  group  were  determined  on  the  basis  of  mean  absolute  error.  Then 
mean  absolute  error  per  stimulus  was  canputed  separately  for  each  group  s 
uerformance  on  the  hard  and  easy  items  in  the  first  and  last  stim^us  sets, 
ilnally,  the  percentage  by  which  error  was  reduced  in  the  last  set  over  the 
first  set  7^as  computed.  All  groups  reduced  their  absolute  error  in  later 
performance  on  the  hard  items  by  approximately  30^  (respectively  30,  29,  31, 

26  and  39%)  •  Butj  on  easy  items  the  group  receiving  no  knowledge  in- 
erased  its  absolute  error  10%,  while  knowledge  groups  either  stayed  at  the 
same  level  or  decreased  (respectively  9>  “2,  32,  22,  and  19^).  a  bnef 

check  on  the  oossibility  this  effect  resulted  from  the  manner  of  selecting 
hard  and  easy  items,  the  same  percentage  was  computed  for  .roup  VI  on  items 
which  it  found  easiest  on  first  encounter.  The  result  was  22%.;  Thus, 
while  practice  with  or  without  knowledge  permitted  a  reduction  in  absolute 
error  on  the  hardest  stimuli,  practice  with  knowledge  was  necessary  for  the 
maintenance  and  improvement  of  performance  on  the  easiest  items.  Several 
other  comparisons  relating  individual  differences,  stimuli,  treatments,  and 
performance  to  each  other  might  profitably  be  made. 

Effects  of  Specificity.  The  second  hypothesis  also  is  regarded  con- 
fiiroed'^Tthi'TiiuItrobtidned.  Rate  and  level  of  learning  to  estimate 
angular  separation  are  directly  related  to  the  specificity  of  the  knovfledge 
of  results  given#  The  groups  vrere  found  to  be  almost  perfectly  ordered 
in  mean  absolute  error  according  to  specificity  and  the  significance  of 
this  ordering  was  substantiated  by  F-ratios  in  all  except  the  first  st^- 
ulus  set.  In  addition,  oaired  comparisons  of  the  group  means  showed  the 

Sterne  groups  to'differ  significant]^.  The  failure  to  find  reliable 
differences  among  adjacent  treatment  groups  is  reaoily  under stanaable  in 
the  li^-ht  of  the  considerable  variability  shown  by  even  the  best  group. 

A  review  of  the  particular  ways  in  which  perfoimance  changed  in  each  of 
the  groups  points  up  the  effects  of  specificity. 


All  the  knowledge  groups  were  reasonably  equal  initially  in  both 
absolute  and  algebraic  error.  V/ith  practice^  all  showed  some  unconfirmed 
tendency  to  make  more  consistent  responses  and  all  shcrTOd  a  reliable  re¬ 
duction  in  absolute  error.  Otheriivise  performance  changes  with  practice 
differed.  Individuals  receiving  merely  a  knov/ledge  of  the  correctness  of 
their  responses  (Groups  II  and  III)  reduced  their  absolute  error  very  grad¬ 
ually  and  never  did  reach  the  level  of  performance  of  those  receiving  addi¬ 
tional  information.  Also,  while  they  displayed  less  constant  error  than 
those  receiving  no  information,  they  appeared  worse  in  this  respect  than 
individuals  receiving  the  more  specific  information.  Since  the  difference 
in  knor^ledge  given  to  Groups  II  and  III  is  one  of  accuracy  or  precision 
of  information  rather  than  of  specificity,  any  differences  in  their  per¬ 
formance  should  not  be  attributed  to  differences  in  specificity.  Thus, 
although  they  did  not  differ  reliably,  those  encountering  the  narrower 
scoring  band  (III)  tended  to  show  less  of  both  types  of  error.  Interest¬ 
ingly,  the  narrower  scoring  band  seemed  to  result  in  a  tendency  to  under¬ 
estimate,  Tihile  the  wider  one  produced  a  confirmed  tendency  to  overestimate. 
Since  the  groups  differ  in  this  respect,  it  seems  likely  that  the  signi¬ 
ficant  overestimation  of  Group  II  was  a  function  of  the  lack  of  precise 
information  rather  than  of  the  lack  of  specific  information. 

Individuals  receiving  information  as  to  the  direction  of  their  error, 
as  well  as  knowledge  of  whether  they  made  one  (Group  IV),  reduced  their 
absolute  error  more  rapidly  and  also  performed  ivith  very  little  constant 
error.  While  their  performance  was  at  no  time  significantly  superior  to 
that  of  the  narrow-tolerance-range  group,  it  was,  on  occasion,  significant¬ 
ly  superior  to  that  of  the  wide-tolerance-range  group.  Thus,  it  can  be  ar¬ 
gued  that  \inder  some  combinations  of  specificity  and  precision  of  informa¬ 
tion,  directional  information  is  superior  to  simple  knowledge  of  correct¬ 
ness  of  response.  Directional  information  did  not  result  in  less  apparent 
variability  around  constant  error. 

Ss  of  both  Groups  V  and  VI  received  relatively  specific  information 
about“their  responses.  In  addition  to  kno^ving  whether  they  had  erred  and, 
if  so,  in  what  direction,  they  also  knew  by  vAiat  amount.  As  an  apparent 
result,  they  reduced  their  absolute  error  qiiite  rapidly  and  to  the  loi.Test 
level  of  all,  were  the  most  consistent,  and  made  very  little  constant  error. 
Vftiile  these  two  groups  did  not  differ  significantly.  Group  V  consistently 
showed  the  least  absolute  error.  This  tendency  may  be  explained  in  at 
least  two  ways.  It  may  be  argued  that  Group  V  was  simply  superior  to  Group 
VI  by  virtue  of  individual  differences,  as  is  suggested  by  their  respective 
errors  on  the  first  stimulus.  Alternatively,  it  may  be  argued  that  Group 
VI  Ss  were  slightly  inferior  because  they  were  forced  to  perform  a  subtrac¬ 
tion  before  they  coxild  make  best  use  of  their  luiowledge  of  results.  They 
may  have  had  to  find  the  difference  betvreen  their  response  and  the  correct 
ore  and  note  the  direction  before  they  could  adequately  use  the  information 
to  guide  future  responses.  If  that  is  true,  then  it  reasonably  may  be  con¬ 
tended  that  to  give  knoiTledge  of  direction  and  amount  of  error  is  to  pro¬ 
vide  more  specific  information  than  that  afforded  by  simply  a  knowledge 
of  the  correct  resoonse.  A  further,  more  sensitive  comparison  of  the  ef¬ 
fects  of  these  two  types  of  kncuvledge  obviously  vrould  be  of  interest. 
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In  smnmary,  the  effects  revievred  are  generally  substantiated  by  sta¬ 
tistical  tests.  It  is  of  additional  interest  that  they  are  exactly  'wiiat 
might  be  expected  on  canmon-sense  grounds.  Information  as  to  whether  he 
had  made  a  wrong  response  would  help  an  individual  to  reduce  his  error 
somewhat,  but  only  to  the  extent  he  could  guess  which  way  and  by  how  much 
he  had  deviated.  As  a  consequence,  he  would  be  prone  to  considerable  var¬ 
iability  and  tendency  to  drift  into  either  over-  or  underestimation.  Addi¬ 
tional  information  as  to  direction  of  error  would  help  him  avoid  constant 
error  and,  as  a  consequence,  reduce  his  absolute  error  without  necessairily 
changing  his  basic  variability  very  much.  Still  further  information  as  to 
amount  of  error  wotild  enable  him  to  perform  more  consistently  and,  in  so 
doing,  decrease  his  absolute  error  as  well. 

Normative  Aspects  and  Stimulus  Effects,  Quite  aside  from  providi.ng 
information  about  knowledge-of-results  conditions,  this  study  also  provides 
useful  information  on  normative  performance  of  angle  estimation,  both  before 
and  after  training.  As  may  be  seen  in  Figures  2  and  3  ^ud  Table  in  the 
absence  of  information  about  their  performance,  Ss  quickly  tended  to  over¬ 
estimate  these  stiiTiuli  by  2  to  3  degrees  with  very  great  variability  (s  in 
the  order  of  11  degrees).  Their  mean  absolute  error  was  over  9  degrees. 

As  they  continued  their  estimations,  they  reduced  their  variability  and 
mean  absolute  error  a  degree  or  so  but  increased  their  tendency  to  over¬ 
estimate  to  about  U*5  degrees.  In  contrast,  those  \^o  received  training 
with  knowledge  of  results  moved  from  similar  initial  performance  levels  to 
terminal  performance  of  almost  undetectable  constant  error  with  half  the 
variability  (s  approximately  6  degrees)  and  an  absolute  error  of  only  around 
U  degrees.  The  performance  of  the  trained  3s  seems  surprisingly  accurate 
in  view  of  the  nature  of  the  stimuli.  The  performance  of  the  untrained 
corresponds  reasonably  well  to  that  of  other  Ss  tested  with  different  ma¬ 
terials  (Reese,  19^33  Baker  and  Grether,  195UT» 

The  stimuli  used  in  this  experiment  differed  considerably  in  diffi- 
c\ilty.  For  example,  the  mean  absolute  error  on  individual  stimuli  of  those 
receiving  no  information  about  their  responses  icnged  from  degrees  to 
1U,3  degrees  on  first  presentation.  This  lack  of  consistency  in  stimulus 
difficulty  reduced  the  power  of  the  experiment  in  that  it  contributed  to 
greater  mthin-group  variability. 

Although  it  was  not  comprehensively  attempted,  an  analysis  of  the  ef¬ 
fects  of  various  stimulus  parameters  on  performance  could  clarify  the  natxire 
of  the  perceptual  processes  involved  in  angle  estimation.  Certainly,  it 
would  be  useful  to  know  what  stimixlus  characteristics  are  the  most  impor¬ 
tant  correlates  of  this  particular  angle  estimation  response  and  how  manip¬ 
ulations  of  them  affect  the  response.  Scxne  characteristics  of  the  stimuli 
used  in  this  experiment  vfere  always  the  same  ^vhile  others  varied  in  a  pre¬ 
cise  way  among  a  limited  number  of  alternatives.  Still  other  characteris¬ 
tics,  such  as  the  projection  and  the  perpendicifLar  distance  of  the  small 
arrow  from  the  command  heading  line,  varied  v/ithin  limits  in  a  haphazard 
fashion.  An  analysis  was  performed  vrith  respect  to  only  one  stimulus  char¬ 
acteristic  Yfhich  vfas  of  special  interest. 
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In  the  course  of  running  Ss  one  E,  Mr.  William  Pearson,  began  to  sus¬ 
pect  that  the  projection  distance  (or  length  of  the  radius  vector  as  he 
termed  it)  played  a  significant  role  in  determining  the  accuracy  of  response. 
(The  projection  distance  may  be  defined  as  the  distance  from  one  or  the 
other  end  of  the  small  arrow  along  its  axis  to  the  conmand  heading  line.) 

As  a  test  of  this  hypothesis,  the  projection  distance  for  each  stimiilus  was 
correlated  with  mean  algebraic  error  (Pearsonian  r)  for  each  group  and  for 
the  first  and  last  stimulus  set  or  presentation.  These  correlations  and 
the  results  of  t-tests  of  their  significance  seem  rather  dramatic.  On  the 
first  presentatron,  the  degree  of  correlation  generally  corresponds  with 
the  specificity  of  knowledge  ranging  from  -0.06  to  0.^6,  with  the  values 
of  O.Ul  and  0.^6  for  Groups  V  and  VI  being  the  only  significant  ones. 

On  the  last  presentation,  however,  all  groups  show  a  reasonably  high  and 
significant  positive  correlation.  For  Groups  I  through  VI  the  values  ob¬ 
tained  are  0.72,  0.^8,  0.7U,  0.81,  0.76  and  0.82  respectively.  This  clear¬ 
ly  suggests  that  with  practice  (with  or  without  knowledge)  projection  dis¬ 
tance  emerges  as  a  stimulus  aspect  to  become  a  very  important  determiner 
of  the  response.  There  also  is  the  suggestion  that  knowledge  speeds  this 
process. 

Generality  of  Results  and  Future  Research.  One  final  question  remains 
to  be  considered:  To  what  extent  may  the  principal  findings  of  this  study 
be  generalized  to  other  tasks  and  situations?  As  was  mentioned,  the  prin¬ 
ciple  of  knowledge  of  resxilts  is  well  supported  by  research  on  a  variety 
of  tasks.  This  study  merely  affords  additional  evidence  for  it.  However, 
the  generality  of  the  principle  that  the  effectiveness  of  knowledge  of  re¬ 
sults  is  a  direct  function  of  specificity  bears  closer  scrutiny. 

Described  in  an  abstract  way,  this  task  required  an  estimation  of  spa¬ 
tial  extent  and  a  translation  of  the  estimate  into  a  scaled  verbal  response. 
Thus,  an  absolute  judgment  of  spatial  extent  had  to  be  made.  It  is  a  rea¬ 
sonable  expectation  that  parallel  variations  in  specificity  would  have  the 
same  general  effects  on  the  acquisition  of  skill  in  making  other  absolute 
judgments  of  spatial  extent.  Of  soraevfhat  less  certainty,  however,  is  urtieth- 
er  the  same  effects  vfould  be  observed  ^vhen  a  relative  judgment  or  compari¬ 
son  of  spatial  extent  was  required  or  when  judgments  about  other  aspects 
of  visual  stimuli  were  required.  In  still  greater  doubt  is  whether  the 
acquisition  of  skill  in  making  judgments  about  stimuli  presented  to  other 
sense  modalities  would  be  similarly  influenced  by  variations  in  specificity. 
In  general,  the  degree  of  certainty  with  which  it  can  be  predicted  that 
increased  specificity  in  knowledge  of  results  vrill  speed  the  acquisition 
of  a  perceptual  skill  depends  directly  on  the  similarity  between  the  task 
involved  and  the  one  used  in  this  study. 

Somewhat  further  along  the  dimension  of  task  similarity  are  a  variety 
of  other  tasks  not  generally  regarded  as  perceptual.  The  applicability  of 
these  findings  to  such  nohperceptual  tasks  may  be  even  more  seriously  dis¬ 
puted.  Additional  research  on  the  effects  of  variations  in  the  specificity 
of  knowledge  on  learning  other  types  of  tasks  would  be  desirable. 
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There  is  another  kind  of  limitation  on  the  generality  of  these  resiilts. 
They  do  not  permit  the  conclusion,  even  for  the  same  task,  that  skill  im¬ 
proved  through  practice  with  relatively  specific  knowledge  of  results  will 
be  strongly  retained  when  knowledge  of  results  is  discontinued  or  that  corre¬ 
spondingly  great  transfer  will  result  in  performing  a  similar  task.  In 
short,  hypotheses  about  retention  and  transfer,  paralleling  those  tested 
by  this  experiment,  should  be  tested  by  further  research. 


SUMMARY 

This  experiment  was  designed  to  test  two  related  hypotheses  regarding 
the  effects  of  knowledge  of  results  on  the  learning  of  a  perceptual  skill. 
The  hypotheses  are  that  (l)  rate  and  level  of  learning  to  make  an  absolute 
judgment  of  spatial  extent  will  be  increased  with  knowledge  of  results  and 
(2)  this  effect  vrill  be  greater  the  more  specific  the  knowledge. 

Ninety  male  undergraduate  subjects  were  assigned  equeilly  and  at  random 
to  six  treatment  groups.  Each  subject  estimated  individually  with  respect 
to  120  stimulus  photos  how  many  degrees  a  -^inch  arrow  would  have  to  be 
turned  to  exactly  parallel  an  adjacent  arrowheaded  line  drawn  across  a  3^ 
inch  circle.  The  stimuli  were  grouped  into  five  sets,  each  set  containing 
copies  of  the  same  2I4.  different  stimuli  in  a  different  random  order.  Cor¬ 
rect  answers  ranged  from  11  through  UU  degrees  and  were  never  repeated  with¬ 
in  a  set.  The  stimuli  were  presented  for  3  seconds  with  10  seconds  between. 
Intervals  of  2  minutes  separated  each  set  of  2U,  except  that  6  minutes  sep¬ 
arated  the  third  and  fourth  sets.  Knowledge  of  results  given  orally  after 
each  estimation  ranged  in  specificity  from  simple  right-wrong  information 
to  amount  and  direction  of  error  information  for  five  experimental  groups. ~ 
No  knowledge  was  given  a  sixth,  control  group. 

Differences  in  mean  absolute  and  algebraic  error  per  stimulus  among 
groups  reflect  differences  in  the  knowledge  given.  With  practice,  those 
who  were  given  no  information  showed  no  demonstrable  change  in  performance. 
They  made  large  absolute  error  (over  8°)  and  tended  toward  increasingly 
consistent  and  significant  overestimation  (about  U.?°  with  s  about  11°). 
Those  who  were  either  given  the  correct  answer  or  told  by  what  amount  suid 
in  what  direction  they  erred  showed  almost  \mdetectable  algebraic  error 
with  half  the  variability  (s  about  6°)  and  very  rapid  reduction  of  abso¬ 
lute  error  to  the  lowest  level  (about  U°).  Between  these  extremes  was  the 
performance  of  those  who  received  rlght-yrrong  information  (with  reference 
to  two  tolerance  ranges)  and  those  who  received  information  as  to  direction 
of  error  only.  Directional  information  was  superior  to  ri^t-wrong  infor- 
mation  (or  simple  knowledge  of  error)  as  shown  by  both  absolute  and  alge¬ 
braic  error. 

In  general,  all  five  knowledge  groups  showed  significant  improvement 
with  practice  and  significant  superiority  to  the  no-knowledge  group  in 
absolute  error.  In  addition,  the  knowledge  groups  were  almost  perfectly 
ordered  in  absolute  error  according  to  the  specificity  of  knowledge  given 
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them.  Over-all  differences  in  their  performance  are  significant  for  all 
except  the  first  stimui.us  set,  as  are  the  differences  between  pairs  of 
groups  receiving  the  more  extreme  treatments.  Most  knowledge  groups  made 
little  constant  or  algebraic  error  but  those  who  received  only  the  simple 
knovfledge  of  error  with  a  wide  tolerance  range  displayed  significant  over¬ 
estimation.  Therefore,  both  hypotheses  are  regarded  confirmed.  However, 
these  findings  should  not  be  applied  indiscrirainantly  to  tasks  not  requir¬ 
ing  an  absolute  judgment  of  spatial  extent  or  to  problems  of  transfer  and 
retention. 
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APPENDIX  A.  The  Stimuli  (half-size  with  coiTect  answers 
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APPENDIX  B 


Instructions  to  Subjects 


"Are  you  familiar  -with  how  angles  are  measured?  V/ell,  if  you  think 
of  a  right  angle  like  the  comer  of  a  sqtiare,  that  would  be  90  degrees. 

Half  of  that  would  be  degrees,  and  so  forth. 

"In  this  experiment  I'm  going  to  show  you  a  series  of  stimulus  cards 
much  like  this  one.  (E  holds  up  sample.)  You'll  see  them  each  time  through 
an  opening  here  (E  points).  For  each  card  imagine  that  you  are  flying  a 
plane  in  the  direction  shown  by  this  small  arrow.  The  long  line  v/ith  the 
arroTf  on  one  end  shows  the  direction  in  which  you  are  supposed  to  fly. 

I'd  like  you  to  tell  me  how  many  degrees  you  would  have  to  turn  to  fly  in 
the  same  direction  as  the  long  line,  that  is,  so  that  the  small  arrovf  wovild 
be  parallel  to  the  line. 

"Do  this  each  time  immediately  after  I  close  the  opening. 

"I'll  let  you  look  at  each  one  for  about  5  seconds,  wait  10  seconds, 
show  you  another  for  ^  seconds  and  so  forth  until  we  have  completed  the 
series.  Then  I'll  wait  2  minutes  before  beginning  the  next  one. 

"Remember  to  give  your  ansiiTer  each  time  without  hesitation  or  delay 
as  soon  as  I  close  the  opening. 

Group  I ;  (E  gives  no  further  instructions.) 

Groups  11  and  III:  "Shortly  afterward  I  vri-ll  say  'right'  or  'wrong' 
to  shovf  you  whether  you  have  made  an  error. 

Group  IV:  "Shortly  afterward  I  will  say  'over,'  '\inder,'  or  'correct,' 
to  show  you  the  direction  of  yotir  error.  'Over'  would  mean  your  estimate 
was  too  high. 

Group  V:  "Shortly  afterward  I  will  say  'over  so  many  degrees'  or 
'under  so  many  degrees'  to  show  the  direction  and  amount  of  your  error. 

'Over  two'  wovild  mean  your  estimate  was  2  degrees  too  high.  If  you  are 
exactly  right.  I'll  say  'correct.' 

Group  VI:  "Shortly  afterward  I  will  tell  you  the  correct  answer  so 
you  will  know  the  direction  and  amount  of  your  error. 

"Do  you  have  any  questions? 

"Ready?"  ... 
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APPEI'JDIX  C 


Mean  Absolute  Error  Per  Stimulus  in  Degrees 

Group 

Set  and 


Stimuli 

I 

n 

III 

V 

VI 

I,  1-6 

9»h 

8.5 

7.3 

7.3 

6.7 

6.5 

I,  7-12 

10.5 

8.0 

8.7 

6.7 

6.7 

6.2 

I,  13-18 

8.3 

8.1 

7.8 

6.6 

5.6 

6.2 

I,  19-2U 

9.5 

8.0 

7.1 

7.0 

5.3 

6.5 

I,  All 

9.ii 

8.2 

7.7 

6.9 

6.1 

6.3 

II,  1-6 

6.3 

7.1 

5.2 

6.3 

U.3 

5.0 

II,  7-12 

8.5 

8.5 

7.2 

6.7 

U.U 

5.8 

II,  13-18 

6.8 

7.8 

6.8 

5.3 

U.7 

5.5 

II,  19-2h 

7.0 

7.7 

7.0 

6.1; 

U.5 

U.6 

II,  All 

7.2 

7.8 

6.6 

6.2 

U.5 

5.2 

III,  1-6 

9.0 

7.2 

8.2 

1;.8 

U.U 

U.5 

III,  7-12 

8.0 

6.6 

6.U 

6.1 

U.6 

U.8 

III,  13-18 

8.3 

7.3 

5.5 

5.9 

U.U 

U.3 

III,  I9-2U 

8.6 

6.8 

6.U 

5.7 

U.7 

5.0 

III,  All 

8.5 

7.0 

6.6 

5.6 

U.5 

U.7 

IV,  1-6 

8.6 

7.5 

6.2 

U.9 

3.8 

5.3 

IV,  -7-12 

8.3 

8.1 

5.5 

U.l; 

U.5 

U.U 

IV,  13-18 

8.8 

7.2 

li.9 

6.0 

5.0 

u.7 

IV,  19-2U 

7.9 

6.7 

7.0 

5.2 

5.0 

U.U 

IV,  All 

8.ii 

7.U 

5.9 

5.1 

U.6 

u.7 

V,  1-6 

8.8 

5.9 

5.9 

U.8 

3.5 

3.9 

V,  7-12 

8.8 

7.8 

5.6 

U.9 

U.U 

U.5 

V,  13-18 

7.9 

5.1 

6.6 

5.3 

U.o 

U.9 

V,  19-2U 

8.2 

5.7 

U.8 

5.6 

U.6 

U.6 

V,  All 

8.1; 

6.1 

5.7 

5.2 

U.l 

U.5 
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APPENDIX  D 


Mean  Algebraic  Error  Per  Stimulus  in  Degrees 


Group 


Set  aind 
Stimuli 

I 

II 

III 

IV 

V 

VI 

I,  1-6 

3.0 

1.9 

-1.0 

0.6 

0.8 

-0.3 

I,  7-12 

2.7 

1.1 

-1.6 

1.9 

1.9 

1.2 

I,  13-18 

3.0 

3.7 

-0.3 

0.6 

0.2 

1.3 

I,  19-2U 

1.2 

1.7 

0.9 

o.U 

0.0 

-2.1 

I,  All 

2.3 

2.1 

-0.3 

0.9 

0.7 

0.0 

II,  1-6 

0.3 

2.8 

0.7 

1.1 

0.8 

0.6 

II,  7-12 

3.3 

3.7 

0.9 

0.9 

0.3 

0.8 

11,  13-18 

2.7 

2.U 

0.3 

0.7 

0.0 

1.2 

II,  19-2U 

1.8 

o.U 

-2.0 

0.9 

—0  .8 

-1.1 

II,  All 

2.1 

2.3 

0.0 

0.9 

0.1 

O.U 

III,  1-6 

U.U 

1.U 

-0.6 

0.6 

-0.7 

0.3 

III,  7-12 

U.7 

-0.7 

-1.0 

0.9 

0.9 

0.3 

III,  13-18 

3.3 

0.8 

—0  .6 

-0.8 

-0.2 

0.1 

III,  19-2U 

2.3 

-0.3 

-i.U 

-0.3 

-0.7 

-0.1 

III,  All 

3.7 

0.3 

-1.0 

0.0 

-0.2 

0.0 

IV,  1-6 

U.8 

1.9 

-0.3 

0.7 

0.9 

1.7 

IV,  7-12 

U.U 

“2.1 

0.7 

l.U 

—0  .6 

0.3 

IV,  13-18 

3.1 

3.9 

-1.0 

0.2 

0.2 

o.U 

IV,  19-2U 

3.5 

2.1 

-1.1 

-1.2 

0.2 

-0.7 

IV,  All 

U.U 

2.3 

—O.U 

0.3 

0.2 

0.3 

V,  1-6 

3.2 

3.U 

0.8 

0.1 

-0.2 

0.1 

V,  7-12 

U.8 

U.2 

0.1 

0.3 

0.0 

1.2 

V,  13-18 

U.2 

2.7 

0.7 

-1.2 

0.2 

0.2 

V,  19-2U 

3.U 

2.3 

O.U 

l.U 

-0.2 

0.0 

V,  All 

U.U 

3.2 

0.3 

0.2 

0.0 

O.U 
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APPENDIX  E 


Significance  of  Differences  in  Mean  Absolute  Error  Per  St^i^us 
between  Pairs  of  Knowledge  Groups  for  Sets  of  Stimuli  (t) 


Knowledge 

Groups 

Compared 

I 

11 

II  vs.  Ill 

0.38 

1.31 

(28) 

(28) 

II  vs.  IV 

1.15 

1.5U 

(28) 

(28) 

II  vs.  V 

1.9U 

U.lU^“''‘ 

(28) 

(19) 

II  vs.  VI 

1.7U 

2.91^^* 

(22) 

(28) 

III  vs.  IV 

0.71 

0.39 

(28) 

(28) 

III  vs.  V 

1.U8 

3.05** 

(28) 

(22) 

III  vs.  VI 

1.25 

1.7U 

(22) 

(28) 

II  and  III 

1.10 

1.11 

vs.  IV 

(i43) 

(U3) 

II  and  III 

2.15"'«- 

U.71^'*' 

vs.  V 

(U3) 

(U3) 

II  and  III 

1.95 

2.88-iH'‘- 

vs.  VI 

(U3) 

(U3) 

IV  vs.  V 

0.90 

2.05 

(28) 

(19) 

IV  vs.  VI 

0.58 

1.07 

(28) 

(25) 

V  vs.  VI 

O.I42 

1.25 

(28) 

(25) 

p  <  .05 

-«-»  p  <  .01 

(df  giver 

Stimulus  Set 

III 

H 

V 

0.27 

1.15. 

0.18 

(28) 

(28) 

(28) 

1.28 

2.21* 

0.75 

(23) 

(2U) 

(28) 

2.1|1* 

3.18** 

2.2U* 

(16) 

(19) 

(15) 

2.20«- 

2.59«^ 

1.61 

(20) 

(28) 

(23) 

l.lU 

1.06 

0.65 

(28) 

(28) 

(28) 

2.61* 

2.12* 

2.53* 

(18) 

(21) 

(16) 

2.37* 

1.56 

1,67 

(2U) 

(28) 

(28) 

1.52 

2.15* 

1.12 

(U3) 

(U2) 

(U3) 

3.1^0--^* 

3.57^'^ 

3.61'is* 

(Uo) 

(UD 

(UO) 

2  .9CHWi- 

2.5U* 

2.39^*- 

(U3) 

(U3) 

(U3) 

1.78 

1.22 

1.90 

(22) 

(28) 

(17) 

1.38 

0.69 

i.oU 

(28) 

(28) 

(28) 

0.02 

0,26 

0.78 

(26) 

X22) 

(18) 

in  parentheses) 
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